Meme as Building Block for Evolutionary 
Optimization of Problem Instances 



Liang Feng, Yew-Soon Ong, Ah-Hwee Tan and Ivor Wai-Hung Tsang* 



Abstract 

A significantly under-explored area of evolutionary optimization in the 
literature is the study of optimization methodologies that can evolve along 
with the problems solved. Particularly, present evolutionary optimization ap- 
proaches generally start their search from scratch or the ground-zero state 
of knowledge, independent of how similar the given new problem of in- 
terest is to those optimized previously. There has thus been the apparent 
lack of automated knowledge transfers and reuse across problems. Taking 
the cue, this paper introduces a novel Memetic Computational Paradigm for 
search, one that models after how human solves problems, and embarks on a 
study towards intelligent evolutionary optimization of problems through the 
transfers of structured knowledge in the form of memes learned from pre- 
vious problem-solving experiences, to enhance future evolutionary searches. 
In particular, the proposed memetic search paradigm is composed of four 
culture-inspired operators, namely, Meme Learning, Meme Selection, Meme 
Variation and Meme Imitation. The learning operator mines for memes in the 
form of latent structures derived from past experiences of problem-solving. 
The selection operator identifies the fit memes that replicate and transmit 
across problems, while the variation operator introduces innovations into the 
memes. The imitation operator, on the other hand, defines how fit memes 
assimilate into the search process of newly encountered problems, thus gear- 
ing towards efficient and effective evolutionary optimization. Finally, com- 
prehensive studies on two widely studied challenging well established NP- 
hard routing problem domains, particularly, the capacitated vehicle routing 
(CVR) and capacitated arc routing (CAR), confirm the high efficacy of the 
proposed memetic computational search paradigm for intelligent evolution- 
ary optimization of problems. 



1 Introduction 



Like gene in genetics, a meme is synonymous to memetic as being the building 
block of cultural know-how that is transmissible and replicable ifTUl . In the last 
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decades, meme has inspired the new science of memetics which today represents 
the mind-universe analog to genetics in cultural evolution, stretching across the 
field of biology, cognition, psychology, and sociology (39). 

Looking back on the history of meme, the term can be traced back to Dawkins 
|[T9l in his book "The selfish Gene", where he defined it as "a unit of information 
residing in the brain and is the replicator in human cultural evolution". Like genes 
that serve as "instructions for building proteins", memes are then "instructions for 
carrying out behavior, stored in brains". As discussed by Blackmore in her famous 
book "The Meme Machine", where she reaffirmed meme as information copied 
from one person to another and discussed on the theory of "memetic selection" 
as the survival of the fittest among competitive ideas down through generations 
0. Other definitions of meme that took flights from there have since emerged to 
include "memory item, or portion of an organism's neurally-stored information" 
041 . "unit of information in a mind whose existence influences events such that 
more copies of itself get created in other minds" [7 ], and "contagious information 
pattern that replicates by parasitically infecting human minds" [26 ]. 

In the context of computational intelligence, particularly evolutionary compu- 
tation, a meme has been perceived as a form of individual learning procedure, adap- 
tive improvement procedure or local search operator to enhance the capability of 
population based search algorithm |T38ll37l . From the last decades, this integration 
has been established as an extension of the canonical evolutionary algorithm, by 
the names of hybrid, adaptive hybrid or Memetic Algorithm (MA) in the literature 
iflOl . where many success stories for solving complex real world search problems 
ranging from continuous optimization 071 . combinatorial optimization E3l 1451 . 
constrained optimization 11471 . multi-objective optimization [29 ] to optimization in 
dynamic environment 11491 , etc., have been reported. In spite of the attention and 
successes that memetic algorithm has enjoyed, meme does seem to play much of a 
complimentary role in computational intelligence, i.e., in the form of a local search 
or refinement operator within the evolutionary search cycle. 

Falling back on the basic definition of a meme by Dawkins and Blackmore, as 
the fundamental building blocks of culture evolution, research on memetic compu- 
tation can perhaps be more meme-centric focus by treating memes as the building 
blocks of a given problem domain, much like gene serving as the building blocks of 
life. Taking the cue, this paper embarks on a study towards a novel Memetic Com- 
putational Paradigm for search, one that models after how human solves problems. 

Today, it is well recognized that the processes of learning and the transfer of 
what has been learned are central to humans in problem-solving [6j. Learning 
has been established to be fundamental to human in functioning and adapting to 
the fast evolving society. Besides learning from the successes and mistakes of 
the past and learning to avoid making the same mistakes again, the ability of hu- 
man in selecting, generalizing and drawing upon what have been experienced and 
learned in one context, and extending them to new problems is deem to be most 
remarkable [8]. Since the inception of artificial intelligence more than five decades 
ago, a significant number of success stories to emulate the learning, reasoning and 
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problem-solving intelligence of humankind have been made. The aspiration has 
been to develop machines that do things like humans are capable of performing 
intelligibly. Within the context of computational intelligence, several core learn- 
ing technologies in neural and cognitive systems, fuzzy systems, probabilistic and 
possibilistic reasoning have been notable for their ability in emulating some of 
human's cultural and generalization capabilities, with many now used to enhance 
our daily life. In spite of the accomplishments made in computational intelligence, 
the attempts to emulate the cultural intelligence of human in search, evolutionary 
optimization in particular, has to date received far less attention. The learning, 
generalization and evolution of useful traits across related tasks or problems and 
the study of optimization methodology that evolves along with the problems solved 
has been significantly under-explored in the context of evolutionary computation. 
In the present study, we aspire to fill in this gap. 

In particular, we propose a memetic search paradigm that takes advantage of 
the possible relations among problem instances, i.e., topological properties, data 
distribution or otherwise, to allow the effective assessments of future unseen prob- 
lem instances, without the need to perform an exhaustive search each time or 
start the evolutionary search from a ground-zero knowledge state. The proposed 
memetic search paradigm is composed of four culture-inspired operators, namely, 
Meme Learning, Meme Selection, Meme Variation and Meme Imitation. The learn- 
ing operator extracts memes in the form of structured knowledge from past expe- 
riences of problem-solving. In the present context, meme manifests as the instruc- 
tions to intelligently bias the search (i.e., thus narrowing down the search space) 
on the given problems of interest. The selection operator, on the other hand, se- 
lects the appropriate or fit memes that shall replicate and undergo innovations via 
the variation operator, before drawing upon them for enhancing future evolution- 
ary optimizations. Last but not least, the imitation operator defines the process 
of memes assimilation into the search process of new problems, via the genera- 
tions of positive biased solutions that would lead to more efficient and effective 
evolutionary searches. 

In this paper, we showcase the proposed memetic evolutionary search paradigm 
on combinatorial optimization problems. Particularly, we consider the general pro- 
gramming problem where there exists a number of agents and a number of tasks. 
Any agent can be assigned to perform any task, incurring some cost and profit that 
may vary, depending on the agent-task assignment. Moreover, each agent has a 
budget constraint and the sum of the costs of tasks assigned to it cannot exceed the 
constraint imposed. The objective is then to find an assignment with maximum to- 
tal profit, while not exceeding the budget imposed on each agent. In the literature, 
several well established combinatorial optimization problems belonging to the de- 
scribed general programming problem include vehicle routing problem [31], gen- 
eralized assignment problem lfT31 . arc routing problem |[23l . etc. To demonstrate 
the memetic computational search paradigm for "intelligent" evolutionary opti- 
mization, the two widely studied challenging routing problem domains, namely, 
capacitated vehicle routing (CVR) and capacitated arc routing (CAR) are show- 
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cased in the current paper. To summarize, the core contributions of the current 
work is multi-facets, which are outlined as follows: 

1. To date, almost all search methods start the optimization process from scratch, 
with the assumption of zero usable information, i.e., independent of how 
similar the current problem instance of interest is to those encountered in the 
pasts. The current work presents an attempt to fill this gap by embarking a 
study on evolutionary optimization methodology with intellectual capabili- 
ties that can evolve along with the problems solved. 

2. To our knowledge, this is the first work that focuses on cultural evolutionary 
optimization of problem instances. It presents a novel effort on learning of 
useful traits from past problem solving experiences in the form of structured 
knowledge or latent patterns as memes, and subsequently through the mech- 
anisms of cultural learning, selection, variation and imitation, appropriately 
acquired knowledge are transferred to enhance the evolutionary search on 
future unseen problems. 

3. Beyond the formalism of simple and adaptive hybrids as memetic algorithm, 
this paper introduces and showcases the novel representation of acquired 
knowledge from past optimization experiences in the form of memes. In 
contrast to the manifestation of memes as refinement procedures in hybrids, 
here memes manifest as natural building blocks of meaningful information, 
and in the present context, serving as the instructions for generating solutions 
that would lead towards optimized solutions both effectively and efficiently. 

4. This work proposes a storage of building blocks or memes to problems that 
share some common characteristics, such as instances from related problem 
domains, and supports the reuse of the memes across problems. The capac- 
ity to imitate and draw on memes from past instances of problem-solving 
sessions thus allows future evolutionary search to be more intelligent, lead- 
ing to solutions that can be attained more efficiently on unseen problems of 
increasing complexity or dynamic in nature. These atomized units of memes 
then form societies of the mind for more effective problem solving. 

5. In the experimental study, the proposed memetic evolutionary search paradigm 
is shown to be more efficient and effective for problem solving than conven- 
tional evolutionary optimization. Specifically, we show that the memetic 
paradigm enhances the search performances of existing state-of-the-art evo- 
lutionary optimization methodologies in the domains of capacitated vehicle 
routing and capacitated arc routing, which contain NP-hard combinatorial 
optimization problems of diverse properties. 

The rest of this paper is organized as follows: a brief discussion on traditional 
evolutionary optimization and the related works is given in Section |2] Section [3] 
introduces the proposed memetic computational search paradigm for "intelligent" 
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evolutionary optimization of problems, via the transfer of structured knowledge 
in the form of memes from past problem-solving experiences, to enhance future 
evolutionary searches. Section [4] presents the brief mathematical formulations of 
the capacitated vehicle routing problem (CVRP) and capacitated arc routing prob- 
lem (CARP), and discusses the existing state-of-the-art optimization methodolo- 
gies for solving CVRP and CARP. Detailed designs of the meme learning, meme 
selection, meme variation and meme imitation operators for routing problems are 
then described in Section[5] Particularly, the culture-inspired operators are realized 
based on the Hilbert-Schmidt Independence (HSIC) [27], Maximum Mean Dis- 
crepancy criteria [4] and K-means Clustering. Last but not least, section [6]presents 
and analyzes the experimental results on the well established CVRP and CARP 
benchmarks, which serve as the representatives routing problems considered in the 
current work. Lastly, the conclusive remarks of this paper are drawn in Section [7] 

2 Related Works 

Evolutionary algorithms (EAs) are approaches that take their inspirations from the 
principles of natural selection and survival of the fittest in the biological kingdom. 
In the last decades, it is becoming well established that many effective optimiza- 
tions using EA have been achieved by the use of inductive biases that fit to the 
structure of the problem of interest well [5]. In spite of the great deal of attention 
that EA has received, where many specialized EAs have been developed with the 
manual incorporations of human expert domain knowledge (and hence inductive 
biases) into the search scheme, it is worth noting here that, existing EA approaches 
have yet to exploit the useful traits that may exist in similar tasks or problems. 
In particular, the study of optimization methodology that evolves along with the 
problems solved has been significantly under-explored in the context of evolution- 
ary computation. Instead, the common practice of evolutionary computation is to 
start the search on a given new problem of interest from ground zero state, indepen- 
dent of how similar the new problem instance of interest is to those encountered 
in the past. Thus a major impediment of existing evolutionary search methodol- 
ogy in the literature is the apparent lack of automated useful knowledge transfers 
and reuse from past problem solving experiences as appropriate biases that can 
enhance evolutionary search of new problems. 

In practice, problems seldom exist in isolation, and previous related problems 
encountered often yield useful information that when properly harnessed, can lead 
to more effective future evolutionary search. To date, few works have attempted to 
reuse useful traits from across problems. Louis et al. IT331 . for instance, presented 
a study to acquire problem specific knowledge and subsequently using them to aid 
in the genetic algorithm (GA) search via case-based reasoning. Rather than start- 
ing anew on each problem, appropriate intermediate solutions drawn from similar 
problems that have been previously solved are periodically injected into the GA 
population. In a separate study, Cunningham and Smyth [17] also explored the 
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reuse of established high quality schedules from past problems to bias the search 
on new traveling salesman problems (TSPs). Despite these early attempts, the idea 
of reusing useful traits from across problems in evolutionary search did not gar- 
ner significant attention. We believe this is a result of the weak generality trait 
of the approaches introduced in these initial studies. Particularly, both ll33l and 
lfT7l considered the exact storage of past solutions or partial-solutions from previ- 
ous problems solved, and subsequently regurgitate them directly into the solution 
population of a new evolutionary search. It is worth noting that such a simple 
scheme of the memory at work would proof to be futile when the nature or char- 
acteristics of the new optimization problem of interest differs, such as the problem 
size or dimensionality, structures, representations, etc. Thus what have been previ- 
ously memorized from past problems solved cannot be directly injected into new 
searches for successful reuse. 

In contrast to existing memory based approaches, the proposed memetic com- 
putational search paradigm addresses the non-trivial task of learning the generic 
building blocks or memes of useful traits from past problems solving experiences 
and subsequently drawing upon them through the cultural evolutionary mecha- 
nisms of meme learning, selection, variation and imitation (as opposed to a simple 
direct copying of past solutions in previous works) to enhance the search on new 
problems. In such a manner, the transfer of memes as generic building blocks of 
useful knowledge, can lead to enhanced search on problems of differing dimen- 
sions, topological structures, and representations, etc. 

3 Memetic Evolution 

In this section we present the proposed memetic computational paradigm for "in- 
telligent" evolutionary optimization, one that is modelled after how human solves 
problems, capable of evolving along with the problems solved. In the proposed 
memetic computational paradigm, the instructions for carrying out the behavior 
to act on a given problem are modeled as memes stored in brains. These memes 
then serve as the building blocks of past problems solving experiences that may be 
efficiently passed on to support the search on future unseen problems, by means 
of cultural evolution. This capacity to draw on memes from previous instances of 
problem-solving sessions thus allows the search to be more intelligent, leading to 
a more effective and efficient future search. 

3.1 Cultural Operators 

The proposed memetic computational paradigm is composed of four culturally- 
inspired operators, namely Meme Learning, Meme Selection, Meme Variation and 
Meme Imitation as depicted in Fig. [Q whose functions are described in what fol- 
lows: 
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- Meme Learning Operator: Given that p corresponds to a problem instance 
and s* denotes the optimized solution of p, as attained by an evolutionary 
solver (labeled here as OS). The learning operator takes the role of mod- 
elling and generalizing the mapping from p to s* , to derive the meme. The 
meme learning process evolves in an incremental manner, and builds up the 
wealth of knowledge in the form of memes, along with the number of prob- 
lem instances solved. Note the contrast to a simple storage or exact memory 
of specific problem instance p with associated solution s* as considered in 
the previous studies based on case-based reasoning Il33l . 

- Meme Selection Operator: Different prior knowledge introduces unique forms 
of bias into the search. Hence a certain biases would make the search more 
efficient on some classes of problem instances but not for others. Inappro- 
priately harnessed knowledge, on the other hand, may lead to the possible 
impairments of the search. The meme selection operator thus serves to iden- 
tify or select the fit memes, from the society of memes, that replicate suc- 
cessfully. 

- Meme Variation Operator: The meme variation forms the intrinsic innova- 
tion tendency of the cultural evolution. Without variations, maladaptive form 
of bias may be introduced in the evolutionary searches involving new prob- 
lem instances. For instance, a piece of knowledge as represented by the 
memes, which has been established as constructive based on its particular 
demonstration of success on a given problem instance would quickly spiral 
out of control via replication. This will suppress the diversity and search 
of the evolutionary optimization across problems. Therefore, variation is 
clearly essential for retaining diversity in the society of memes towards effi- 
cient and effective evolutionary search. 

- Meme Imitation Operator: From Dawkins's book entitled "The selfish Gene" 
Ifl9l , ideas or memes are copied from one person to another via imitation. In 
the present context, memes that are learned from past problem solving expe- 
riences replicates by means of imitation and used to enhance future evolu- 
tionary search on newly encountered problems. 

3.2 ''Intelligent' Evolutionary Optimization via Memetic Evolution 

In the spirit of how human solves problems, the schemata representation of meme 
in computing as the structured knowledge or latent patterns that is encoded in the 
mystical mind of nature is first identified. The problem solving experiences on the 
encountered problems are then captured via meme learning and crystallized as a 
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Figure 1 : A depiction of how human solves problems in Memetic Computation. 

part of the meme pool that form the building blocks in the society of mind |[36l . In 
this manner, whenever a new problem comes about, the meme selection operator 
kicks in to first identify the appropriate memes from the wealth of previously ac- 
cumulated memes. These memes then undergo variations to effect the emergence 
of innovative memes. Enhancements to subsequent problem-solving effectiveness 
and efficiency on given new problems is then achieved by means of meme imita- 
tion. 

Referring to Fig. [TJ at time step i = 1, the optimization solver OS is faced 
with the first problem instance p 1 to search on. Since p 1 denotes the first problem 
of its kind to be optimized, no memes is available for enhancing the evolutionary 
solver, OS, search. Q This is equivalent to the case where a novice encounters a 
new problem of its kind to work on, in the absence of a prior knowledge that he/she 
can leverage upon. This condition is considered as "no relevant meme available" 
and the search by solver OS shall proceed normally, i.e., the meme selection op- 
erator remains dormant. The corresponding optimized solution attained by solver 
OS on p 1 is denoted by s 1 *. Through the meme learning operator, meme Mi is 
learned and derived from the problem instance and corresponding optimized solu- 
tion denoted by (p 1 , s 1 *). On subsequent unseen problem instances j = 2, ... ,00, 
meme selection kicks in to identify the appropriate memes Ms from the society of 
memes denoted by SoM. Activated memes Ms then undergo the variation opera- 
tor to arrive at innovative meme M t that serves as the instructions imitated to bias 
subsequent evolutionary optimizations by OS. In this manner, useful memes of 
experiences attained from previously solved problem instances are captured incre- 
mentally and archived in meme pool SoM to form the society of mind, which are 

'Unless, of course, a database of memes that are learned from past problem solving experiences 
can be loaded and leveraged upon. 
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appropriately activated to enhance future search performances. 

Like the memes stored in the human mind to aid in the coping of our everyday 
life and problem solving, memes residing in the artificial mind of the evolutionary 
solver play the role of positively biasing the search on newly encountered prob- 
lems. In this manner, the intellectual capability of the evolutionary solver evolves 
along with the number of problems solved, with transferrable memes accumulating 
with time. When a new problem is encountered, fit memes are activated and varied 
to instruct and guide the intelligent solver in the search process. The mind-universe 
of memes thus formed the evolving domain knowledge that may be activated to 
solve future evolutionary search effectively and efficiently. 

4 Case Studies on Routing Problems 

In this section, we illustrate the proposed memetic computational paradigm for 
"intelligent" evolutionary optimization on the class of combinatorial optimization 
problem. Particularly, our interest is on the general problem scenario where there 
exist a number of agents and a number of tasks. Any agent can be assigned to 
perform any task, incurring some cost and profit that may vary depending on the 
agent-task assignment. Moreover, each agent has a budget and the sum of the 
costs of tasks assigned to it cannot exceed this budget. It is required to find an 
assignment in which all agents do not exceed their budget and the total profit of the 
assignment is maximized. It is worth highlighting the practicality of described sce- 
narios, where a plethora of today's real world complex problems can be established 
to exhibit many of the properties outlined. These include the well known combina- 
toric problems like vehicle routing in urban waste collection or post delivery, plant 
location, resource scheduling, flexible manufacturing systems, generalized assign- 
ment problem [ 15], job scheduling problem |[28l . and arc routing problem B31I23TL 
etc. To demonstrate the memetic computational search paradigm for "intelligent" 
evolutionary optimization, the two widely studied challenging domains of the ca- 
pacitated vehicle routing problem (CVRP) and capacitated arc routing problem 
(CARP) are showcased in the present section. 

4.1 Capacitated Vehicle Routing Problem 

The capacitated vehicle routing problem (CVRP) introduced by Dantzig and Ramser 
UH, is a problem to design a set of vehicle routes in which a fixed fleet of de- 
livery vehicles of uniform capacity must service known customer demands for 
single commodity from a common depot at minimum cost. The CVRP can be 
formally defined as follows. Given a connected undirected graph G = (V,E), 
where vertex set V = {vi},i = 1 ... n, n is the number of vertices, edge set 
E = = l...n denoting the arc between vertices V{ and Vj. Vertices 

Vd corresponds to the depot at which k homogeneous vehicles are based, and the 
remaining vertices denote the customers. Each arc is associated with a non- 
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negative weight Cjj , which represents the travel distance from Vi to Vj . Consider 
a demand set D = {d(vi)\v{ G V}, where d(vi) > implies customer Vi requires 
servicing (i.e., known as task), the CVRP consists of designing a set of least cost 
vehicle routes TZ = {Ci}, i = 1 . . . k such that 

1. Each route Ci, i G [l,k] must start and end at the depot node v& G V. 

2. The total load of each route must be no more than the capacity W of each 
vehicle, £ v „. 6C d(u;) < W. 

3. Vu* G V and d{vi) > 0, there exists one and only one route Ci G TZ such 
that Vi G Ci. 

The objective of the CVRP is to minimize the overall distance cost(R) traveled 
by all k vehicles and is defined as: 

k 

cost(R) = J^c(Ci) (1) 

i=l 

where c(Cj) is the summation of the travel distance contained in route Cj. 
4.2 Capacitated Arc Routing Problem 

The capacitated arc routing problem (CARP) was first proposed by Golden and 
Wong f24l in 1981. It can be formally stated as follows: Given a connected undi- 
rected graph G = (V, E), where vertex set V = {vi}, i = 1 . . . n, n is the number 
of vertices, edge set E = {e^}, i = 1 . . . m with m denoting the number of edges. 
Consider a demand set D = {d(ej)|e, G E}, where d(e») > implies edge e, 
requires servicing (i.e., known as task), a travel cost vector Ct = {ct{^i)\^i G E} 
with ct(ej) representing the cost of traveling on edge e^, a service cost vector C s = 
{c s {ei)\ei G J5} with c s (ej) representing the cost of servicing on edge ej. A solu- 
tion of CARP can be represented as a set of travel circuits 1Z = {Ci}, i = 1 . . . k 
which satisfies the following constraints: 

1. Each travel circuit Ci, i G [1, k] must start and end at the depot node Vd G V. 

2. The total load of each travel circuit must be no more than the capacity W of 
each vehicle, Ylv ei ec ^( e «) — W. 

3. Vej G E and d(ei) > 0, there exists one and only one circuit Ci G TZ such 
that e, G Cj. 

The cost of a travel circuit is then defined by the total service cost for all edges 
that needed service together with the total travel cost of the remaining edges that 
formed the circuit: 

cost(C) = c s{ei) + Yl Ct ^ (2) 
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where C s and Ct are edge sets that required servicing and those that do not, respec- 
tively. And the objective of CARP is then to rind a valid solution 1Z that minimizes 
the total cost: 



4.3 Present State-of-the-art Evolutionary Optimization Methodolo- 



Theoretically, CVRP and CARP have been proven to be NP-hard with only ex- 
plicit enumeration approaches known to solve them optimally. However, large 
scale problems are generally computationally intractable due to the poor scala- 
bility of most enumeration methods lfl4l . From a survey of the literature, meta- 
heuristics, heuristics and evolutionary computation have played important roles 
in algorithms capable of providing good solutions within tractable computational 
time. For CVRP, Cordeau et al. |[T6l considered a unified tabu search algorithm 
(UTS A) for solving VRP Prins ED presented an effective evolutionary algorithm 
with local search for the CVRP, while Reimann et al. |42] proposed a D-ants al- 
gorithm for CVRP which equipped ant colony algorithm with individual learning 
procedure. Recently, Lin et al. 021 takes the advantages of both simulated anneal- 
ing and tabu search, and proposed a hybrid meta-heuristic algorithm for solving 
CVRP. Further, Chen et al. [11] proposed a domain-specific cooperative memetic 
algorithm for solving CVRP and achieved better or competitive results compared 
with a number of state-of-the-art memetic algorithms and meta-heuristics to date. 

On the other hand, for CARP, Lacomme et al. in QUI presented the basic com- 
ponents that have been embedded into memetic algorithms (MAs) for solving the 
extended version of CARP (ECARP). Lacomme's MA (LMA) was demonstrated 
to outperform all known heuristics on three sets of benchmarks. Recently, Mei et 
al. Il3~5l extended Lacomme's work by introducing two new local search methods, 
which successfully improved the solution qualities of LMA. In a separate study, 
a memetic algorithm with extended neighborhood search was also proposed for 
CARP in [45]. Further, Liang et al. proposed a formal probabilistic memetic algo- 
rithm for solving CARP, with new best-known solutions to date found on 9 of the 
benchmark problems E3l . 

The problem of solving CVRP and CARP can be generalized as searching for 
the suitable task assignments (i.e., vertices or arcs that require to be serviced) of 
each vehicle, and then finding the optimal service order of each vehicle for the 
assigned tasks. In the evolutionary search literature, the task assignment stage 
has been realized by means of simple task randomization ll46ll to more advance 
strategies like heuristic search Il46l fTTTi . clustering [50], etc., while the optimal ser- 
vice order of each vehicle is achieved via the mechanisms of evolutionary search 
operators. The example of an optimized CVRP or CARP solution can be illus- 
trated in Fig. [2j where four vehicle routes, namely, R\ = {0, vi, v 2 , V3, 0}, R2 = 
{0, v 6 , v 5 , v 4 ,0}, R 3 = {0, vio, v 9 , v 8 , v 7 ,0} andi? 4 = {0, vu, vi 3 , v i2 , vn, 0}, 




(3) 
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can be observed. A '0' index value is assigned at the beginning and end of route to 
denote that each route starts and ends at the depot. 
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Figure 2: An example of the CARP and CVRP. 

In the rest of the paper, we shall illustrate the concept of memetic evolution, 
which learns and extracts useful traits from past problem solving experiences as 
memes or structured knowledge, for "intelligent" evolutionary optimization of real 
world CVRPs and CARPs. In particular, we model the mapping of solved CVRP or 
CARP instances to their optimized solutions as memes, which serves as the instruc- 
tions for carrying out the behavior that shall subsequently be used to appropriately 
bias the search on new unseen CVRP or CARP instances, respectively. 



5 Memetic Computational Paradigm for "Intelligent" Evo- 
lutionary Optimization of Routing Problems 

In this section, we present a realization of the proposed memetic computational 
search paradigm, particularly focusing on the cultural-inspired operators, namely, 
meme learning, meme selection, meme variation and meme imitation, which are 
designed for solving routing problems (i.e., such as CARPs and CVRPs) and other 
related problem domains. The "intelligent" evolutionary optimization process of 
routing problem instances using the mechanisms of memetic evolution is next de- 
scribed. 

In particular, the pseudo-code and detailed workflow of the proposed memetic 
computational paradigm for evolutionary optimization of routing problem instances 
are outlined in Algo. [T]and Fig. |3j respectively. For a given new routing problem 
instance p 3 n ew (with data representation ~K J new ) posed to evolutionary solver OS, 
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the mechanisms of the meme selection operator kicks in to select the fit memes 
Ms to activate, if the SoM meme pool is not empty. Meme variation, which takes 
inspirations from the human's ability to generalize from past knowledge learned in 
previous problem solving experiences, then operates to generalize the activated Ms 
to arrive at M t . Subsequently, for given new problem instance X. J new , meme imita- 
tion then proceeds to positively bias the search of evolutionary optimization solver 
OS, with meme (i.e., generalized M t ) induced solutions that enhance the search 
performances on p 3 new . In our work, the meme induced solutions of tasks assign- 
ment and service orders are obtained by means of simple clustering and pairwise 
distance sorting (PDS), respectively, which shall be detailed later in Section [5~4l 
When the search on pn ew completes, the problem instance pn ew together with the 
obtained optimized solution Sn ew of OS, i.e., (X^ eu) , Y 3 new ), shall then undergo 
the meme learning operation so as to update the SoM meme pool of the intelligent 
OS evolutionary solver. 




{P' 



l,...,n 



Pnew = {p'l j = ft + l,...,00} 

,SL={s g \ g = l...,Po P Size} 
Problem Solver 



Problem Solutions 



Sou = {s'*l i = l,...,n} 



Meme Learning 
via HSIC 




Society of Memes 
SoM = {M I / = !,...,« 




Meme Selection via 
HSIC and MMD 



| Ms 
Meme Variation 
via Generalization 



I M, 
Meme Imitation via 
Clustering and Pairwise 
Distance Sorting 



Memetic Evolution 



Figure 3: Memetic Computational Paradigm for "Intelligent" Evolutionary Opti- 
mization of Problems. 
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Algorithm 1: Pseudo code of the Memetic Computational Search Paradigm 
for "Intelligent" Evolutionary Optimization of Routing Problems 

Begin: 

for j = 1 : oo new problem instances phew or X^ eu , do 
if SoM! = 0then 

/*meme pool not empty*/ 

Perform meme selection to identify fit memes Ms € SoM /*see 
Eqn. \\Vt in later Section O 

Perform meme variation to generalize Ms to derive M t . 

Empty the initial population Q,. 

for g = 1 : Population Size do 

Perform meme imitation with X.h ew and M t to obtain solution 



Bg. 



a. Xi 



Mt 



= Trans form (X^< 
/*Fig. [Ha)^Fig. ED>)*/ 

b. Task Assignment of s g = 

KMeans(X.i iew , Vehicle No.,RI) 
/Fig. [fjb)— >Fig. [6£c), i?/ denotes random 
initial points*/ 

c. Service Order of s g = PDS(X. J new ) 
/*Fig. [Sc)^Fig. Etd), PZ)5(0 denotes the 
pairwise distance sorting*/ 

d. Insert s g into 17. 



else 



Proceed with the original population initialization scheme of the 
evolutionary solver OS. 

/*Start of Evolutionary Solver OS Search*/ 

Perform reproduction and selection operations of OS with generated 
population s g s until the predefined stopping criteria are satisfied. 
/*End of Evolutionary Solver OS Search*/ 



Perform meme learning on given 



solution sh* ew denoted by (X J new ,Y J neu . 



solver to derive meme Mr, 



and corresponding optimized 
), attained by OS evolutionary 



■new- 



Archive the learned meme of phew into SoM meme pool to update the 
society of meme for subsequent reuse. 



27 End 
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5.1 Meme Learning Operator in Routing Problem 



This subsection describes the learning and extraction of memes as building blocks 
of useful traits from given routing problem instances p and the corresponding opti- 
mized solutions s* (i.e., Line 22 in Alg. [[])■ To begin, we refer to Fig. [2]and Fig. [4J 
which shall serve as the example problem instance used for our illustrations. Fig. 
[4fa) depicts the distribution of the tasks in the example routing problem of Fig. [2] 
that need to be serviced. Fig. HJb), on the other hand, denotes the optimized rout- 
ing solution of the OS evolutionary solver on problem Fig. [2] and Fig. H^a). The 
dashed circles in Fig. HJb) denote the optimized task assignments of the individual 
vehicles, and the arrows then indicate the optimized tasks service orders by OS. 




Meme Learning 



I 

Learned Meme M 




(c) Meme Induced Tasks 
Distribution and Assignments 



Figure 4: Meme as the instructions for "intelligent" tasks assignment and ordering 
of routing problems. 

Here a meme M thus hosts the instructions for transforming the original distri- 
bution and service orders of tasks, to one that realigns well or is closer to the desired 
tasks distribution and tasks service orders, as defined by the optimized routing so- 
lution s* attained by solver OS. Using the example routing problem instance in 
Fig. |2j our objective is thus to find the meme M that transforms the task distri- 
butions depicted in Fig. HI a), to the desired tasks distribution of s* and preserves 
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the corresponding tasks service orders as depicted in Fig. ffib). In this manner, 
whenever a new routing problem instance is encountered, suitable learned or cap- 
tured memes from previously optimized problem instances can then be deployed 
to realign the tasks distribution and service orders accordingly. For instance, Fig. 
Uc) showcases the desirable scaled or transformed tasks distribution of Fig. |4la) 
when the appropriate meme M is put to work. In particular, it can be observed 
in Fig. @Ic) that we seek for meme(s) capable of re-locating tasks serviced by a 
common vehicle to become closer to one another (as desired by the optimized so- 
lution s* shown in Fig. HJb)), while tasks serviced by different vehicles are kept 
further apart. In addition, to match the service orders of each vehicle to that of 
the optimized solution s*, the task distribution is adjusted according to the sorted 
pairwise distances in ascending order (e.g., the distance between v\ and vs is the 
largest among v\, V2 and U3, while the distance between v\q and vg is smaller than 
that of via and v$). 

Next, the mathematical definitions of meme M to achieve the transformations 
of tasks distribution are detailed. In particular, given V = {vj \i = 1, . . . , n}, n is 
the number of tasks, denoting the tasks of a problem instance to be assigned. The 
distance between any two tasks Vj = (vn, . . . , Vi p ) T and Vj = (vji, . . . , Vj p ) T in 
the p-dimensional space MP is then given by: 



d M (vi,Vj) = ||v» - Vj\\M = y (vj - Vj) T M(vi - vj) 

where T denotes the transpose of a matrix or vector. Meme M is positive 
semidefinite, and can be decomposed as M = LL T by means of singular value de- 
composition (SVD). By substituting this decomposition into £/m(vi, Vj), we arrive 
at: 

djlf fa, = ^(L^-L^) T (L^ Vi -L^) (4) 

From equation^ it is worth noting that the distances among the tasks are scaled 
by meme M. Such a meme M shall then perform the realignment of tasks dis- 
tribution and service orders of a given new problem instance to be closer to the 
optimized solution s* of a related problem instance that has been previously en- 
countered. 

In what follows, the mathematical formulations for the automated learning of 
meme M are detailed. The schemata representations of a problem instance (p), 
optimized solution (s*) and distance constraints set M are first defined. In particu- 
lar, the data representations of the example problem instance in Fig. [2] is depicted 
in Fig. 12 where v\i, v\2, etc., denote the features representation of each task, and 
D(-) indicates the Euclidean distance metric. Further, if task Vj and task Vj are 
served by the same vehicle, Y(i,j) = 1, otherwise, Y(i,j) = —1. 

To capture meme M from a given CVRP or CARP problem instance, denoted 
by (p, s*), we formulate the learning task as a maximization of the dependency be- 
tween X and Y according to the Hilbert-Schmidt Independence Criterion (HSIC) 
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x= 



VI V2 

VII V21 
V12 V22 



Vlp V2p 



.. Vl4 

.. V141 
.. V142 



V14p 



Y= 



1 


2 3 ... 


13 


14 




■ 1 


11.. 


. -1 


-1 " 


h- 1 


1 


11.. 


. -1 


-1 




1 


11.. 


. -1 


-1 


UJ 


-i 


-i -l . 


. i 


1 


h- 1 
UJ 


_ -l 


-1-1. 


. l 


1 _ 


h-^ 



D(Vl, Va) > D(Vi, Vz) 
D(Vi, Va) > D(V 2 , Va) 
D(Ve, V 4 ) > D(Vs, Vs) 
D(Ve, V 4 ) > D(Vs, Vt) 
D(Vio, V?) > D(Vio, Vs) 
D(Vio, Vs) > D(Vio, V 9 ) 
__D(Vio, V?) > D(Vg, V 7 ) 



D(Vg, Vy) > D(Vs, V?) ~" 
D(vi4, Vn) > D(Vi4, V12) 
D(Vi4, V12) > D(Vi4, Via) 
D(Vi4, V11) > D(Via, V11) 
D(Vi4, V11) > D(Vi2, V11) 



Figure 5: Data representations of a problem instance p = X, the corresponding 
optimized solution s* = Y and distance constraints set J\f. 



[21 \ with distance constraints, which is mathematically defined as: 

max tr(HKHY) (5) 

K 

s.t. K = X T * M * X 

Dij > D iq ,V(i,j,q) G M 

k y 

where tr(-) denotes the trace operation of a matrix. X, Y are the matrix represen- 
tations of a CARP or CVRP instance p and the corresponding problem solution s*, 
respectively. 

Further, H = I — ^11' centers the data and the labels in the feature space, I 
denotes the identity matrix, n equals to the number of tasks. Dij > Di q is the 
constraint to impose that upon serving task i, task q is served before task j by the 
same vehicle. 



Let Tij denotes a n x n matrix that takes non-zeros at Ta 



T. 



j. 1 



1, 



Tji = —1. The distance constraints Dij > Di q in Equation [5] can be reformulated 
as tr(KTij) > tr(KTi q ). Further, slack variables are introduced to measure 
the violations of distance constraints and penalize the corresponding square loss. 
Consequently, by substituting the constraints into Equation [5J we arrive at: 

-tr(XHYHX r M) + ^4, 

M y 

£r(X T MXTjj) > tr(X T MXT l(? ),V(i,i,g) € M 



mm 
s.t. 



(6) 



where C balances between the two parts of the criterion. The first constraint en- 
forces the learnt meme denoted by matrix M to be positive semi-definite, while the 
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second constraint imposes the scaled distances among the tasks to align well with 
the desired service orders of the optimized solution s* (i.e., Y). 

To solve the learning problem in Equation [6j we first derive the minimax op- 
timization problem by introducing dual variables a for the inequality constraints 
based on Lagrangian theory. 

Lr = tr(-HX T MXHY) + ^^4- 

- MMX T MXT-) _ tr(X T MXT ig )) (7) 

Set #E = 0, we have: 

c Y ~ ai ii = ^ = -Q S ai ™ (8) 

By substituting Equation [8] into Equation |7J we reformulate the learning problem 
in Equation [6] as a minimax optimization problem, which is given by: 

maxmin ir[(-XHYHX T - ^ a i j q X.T ij 'X?' 

+ Y a t3q XT iq X. T )M] (9) 

s.t. m y o 

By setting 

A = XHYHX T + Y n, M XT, ; X r - ^ Q, :j ,XT i5 X T 

and 

A4, = tr[(XT iq X T - XTjjX T )M] - ±a ijq 

C is configured with a default value of 10 in the learning problem of Equation 
|9j and then Equation |9]can be solved as described in lf5T), 

5.2 Meme Selection Operator in Routing Problem 

Since different meme introduces unique biases into the evolutionary search, inap- 
propriately chosen memes and hence biases can lead to negative impairments of 
the evolutionary search. To facilitate a positive transfer of memes [40] that would 
lead to enhanced evolutionary search, the meme selection operator (i.e., Line 5 in 
Alg. []} is designed to select fit memes that shares common characteristics with the 
given new problem of interest to replicate. 

Suppose there is a set of n unique Ms in SoM, i.e., SoM = {Mi, M2, . . . , M n } 
that form the society of memes. The meme selection operator is here realized as to 
identify the weight in of each meme. A fitter meme should have a higher weight 
and the summation of the weights of all memes equates to 1 (i.e., Ya=i ^ = 
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In particular, the meme coefficient vector /x is determined based on the HSIC 
and Maximum Mean Discrepancy criteria HI . 

m 

max tr(HKHY) + 'S^( f i i ) 2 Sim i (10) 

n 

s.t. M t = W M » 

i=i 

K = X T * M t * X, K >r 

m > 

n 

Z)^ = 1 

1=1 

By substituting the constraints of Equation [10] into the objective function, we 
arrive at: 

m 

max tr(HX T M t XHY) + s ^{^ i ) 2 Sim t (11) 

4 = 1 

n 

s.t. M t = 5^^Mi,Mi h0 

i=l 

A*i > 

n 

= 1 

i=l 

where Sim^ is the similarity measure between two given problem instances. In the 
present context, Sirrii = -(/3 * MMDi + (1 - fS) * Lh'/j), where MM A denotes 
the Maximum Mean Discrepancy H, which is used to compare the distribution 
similarity between two given instances by measuring the distance between their 
corresponding means. MMD(D s ,D t ) = H^ELi^f) ~ ^E*=i^!)ll> 
where <p(-) maps the original input to a high dimensional space. Here, for the 
purpose of computational efficiency, we consider a linear mapping with 0(x) = x. 
Difi denotes the difference in vehicle capacity for two given CARP or CVRP 
instances. /3 balances between the two parts (i.e., MMDi and Difi) in Sirrii. 
From experiences, due to the higher relevance of the task distribution features than 
vehicles capacity when defining the similarities between problem instances, here /3 
is configured as 0.8. In Equation[lOl the first term serves to maximize the statistical 
dependence between input X and output label Y for clustering Il44l . The second 
term measures the similarity between the previous problem instances solved to the 
given new problem of interest. 

In Equation [TT] two unknown variables exist (i.e., fj, and Y). Y is obtained 
from the results of task assignment. With Y fixed, Equation [TT]becomes a quadric 
programming problem of \i. To solve the optimization problem of Equation [TTJ 
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Table 1 : Criteria for measuring performance. 



Criterion 


Definition 


Number of Fitness Evaluation 


Average number of fitness evaluations across all independent runs conducted 


Cpu Time 


Average computational cost in wall-clock time across all independent runs conducted 


Ave. Cost 


Average fitness of the solutions obtained across all independent runs conducted 


B.Cost 


Best fitness of the solutions obtained across all independent runs conducted 


Std.Dev 


Standard deviation of the solutions' fitness across all independent runs conducted 


Success No. 


Number of independent runs that fare above the Ave.Cost value 



Table 2: Properties of the "Augerat" CVRP data set. 



Data Sei 


A-n«-k5 


A-n54-k7 


A-n60-k9 


A-o69-k9 


A-t80-kl0 


B-n41-k6 


B-n57-k7 


B-n63-kl0 


B-n68-k9 


B-n78-kl0 


P-n50-k7 


P-n7Md 


V 


31 


53 


59 


08 


79 


40 


56 


62 


67 


77 


49 




O v 


ion 


inn 


100 


100 


100 


100 


100 


100 


100 


100 


150 


280 


LB 


784 


1107 


1354 


1159 


1763 


829 


1140 


1490 


1272 


1221 


554 


627 



we first perform clustering (e.g., K-Means) on input X directly to obtain the label 
matrix Y. By keeping Y fixed, we obtained fi by maximizing Equation \TT\ via 
quadric programming solver. Next, by maintaining the chosen M fixed, clustering 
is made on the new X (i.e., transformed by selected M. X' = L T X, where L is 
obtained by SVD on M) to obtain label matrix Y. 

5.3 Meme Variation Operator in Routing Problem 

Further, to introduce innovations into the selected fit memes during subsequent 
reuse, the meme variation operator (i.e., Line 6 in Alg. [TJ then kicks in to operate 
on the selected memes. In the present context, we take inspirations of human's 
ability to generalize from past problem solving experiences. Hence meme variation 
is realized here in the form of memes generalization. However, it is worth noting 
that other alternative forms of probabilistic scheme in meme variations may also 
be considered since uncertainties can generate growth and variations of knowledge 
that we have of the world fi3l . hence leading to higher adaptivity capabilities for 
solving complex and non-trivial problems. 

In particular, the generalized meme M t in meme variation is realized as a linear 
combination of the selected memes: 

n n 

M t = Hi = 1, IH G [0, 1]) 

i=l i=l 

5.4 Meme Imitation Operator in Routing Problem 

In many routing problems, such as CVRP and CARP, the search for optimal so- 
lution is typically solved as two separate phases. The first phase involves the as- 
signment of the tasks that require services to the appropriate vehicles. The second 
phase then serves to find the optimal service order of each vehicle for the assigned 
tasks obtained in phase 1. 

In what follows, the meme induced solutions that serve as initial population 
to intelligently bias the OS search shall be described. For each solution s g , the 
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(c) K-Means Clustering on 
Meme Transformed Task 
Distribution 



(d) Obtain Service Orders via 
Pairwise Distance Sorting (PDS) 



Figure 6: Illustration of meme imitation for generating intelligently biased CVRP 
or CARP solutions. 



imitation of tasks assignments and tasks service orders using generalized meme 
then lead to a transformation (i.e., Line 10 in Alg. [J) of the original tasks 
distribution X. J new to a meme induced tasks distribution ~K J new , which is given by: 



^■new ^ X^ elu (12) 

where L is derived by means of singular value decomposition on M t . The illus- 
trative example is depicted in Fig. [6l where Fig. 0a) denote the original task 
distribution ~K J new and Fig. [6tb) is the resultant meme induced tasks distribution 
Xl ew using M t . 

In phase 1, simple clustering scheme such as K-Means clustering with random 
initializations is then conducted on the meme induced tasks distribution ~K 3 new to 
derive the tasks assignments of the vehicles as depicted in Fig. 0c), where the 
dashed circles denote the task assignments of the individual vehicles, i.e., denoting 
the tasks that shall be serviced by a common vehicle. 

In phase 2, the service orders of each vehicle are subsequently achieved by 
sorting the pairwise distances among tasks in an ascending order. The two tasks 
with largest distance shall denote the first and last tasks to be serviced. Taking the 
first task as reference, the service order of the remaining tasks are defined according 
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Table 3: Properties of the "CE" and "Christofides" CVRP data sets. 



Data Set 


E-n33-k4 


E-n76-k7 


E-n76-k8 


E-n76-kl0 


E-n76-kl4 


E-nl01-k8 


c50 


c75 


clOO 


clOOb 


cl20 cl50 


cl99 


V 


32 


75 


75 






100 


50 


75 


100 


100 


120 150 


199 


<?« 


8000 


220 


180 


140 


100 


200 


160 


140 


200 


200 


200 200 


200 


LB 


835 


082 


735 


830 


1021 


815 


524.61 


■;:;,::<; 


826.14 


819.56 


1042.11 1028.42 


1291.15 



to the sorted orders. Taking Fig. 0d) as example, where the arrows indicate the 
service orders of the tasks, the distance between vi and V3 are largest among vi , 
V2 and V3. By assigning vi as the reference task to be served, V2 shall be the next 
task to be serviced, since the distance between vi and V2 is smaller than that of vi 
and V3. 

6 Experimental Study 

To evaluate the efficiency and effectiveness of the proposed memetic evolutionary 
search paradigm, empirical studies conducted on the challenging domains of ca- 
pacitated vehicle routing problems (CVRPs) and capacitated arc routing problems 
(CARPs) are presented in this section. These consist of problems of diverse prop- 
erties in terms of vertices size, graph topologies, etc., which cannot be handled 
using existing case based reasoning approaches f33l [P71 as previously discussed 
in Section |2 Two state-of-the-art evolutionary algorithms for solving CVRPs and 
CARPs, labeled in their respective published works as CAMA [9] and ILMA |[35ll . 
are considered here as the baselines conventional evolutionary solver, of the re- 
spective domains, in the proposed memetic search paradigm. In this study, several 
criteria have been defined to measure the search performances, which are listed in 
Table Q] Among these criteria, Number of Fitness Evaluation and Cpu Time 
are used to measure the efficiency of the algorithms, while Ave. Cost, B.Cost 
and Success No. serve as the criteria for measuring the solution qualities of the 
algorithms. 

6.1 Capacitated Vehicle Routing Problem 
6.1.1 Empirical Configuration 

All three commonly used CVRP benchmark data sets are investigated in the present 
empirical study, namely "AUGERAT" [1 ], "CE" 03 and "CHRISTOFIDES" HI. 
The "Augerat" dataset includes 12 CVRP instances, "CE" consists of 6 CVRP in- 
stances, and "Christofides" has 7 CVRP instances. The detailed properties (e.g., 
number of vertices, lower bound, etc.) of the CVRP instances considered are sum- 
marized in Tableland Tabled where V denotes the number of vertices that need 
to be serviced, C v gives the capacity of the vehicles in each instance, and LB 
describes the lower bound of each problem instance. Note the diversity in the 
properties of the problems considered. 

In CVRP, each task or vertex has a corresponding coordinates and demand. 
Using the coordinates of the vertex, the tasks assignment of each vehicle are 
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Table 4: Statistic results of CAMA, CAMA-R, and CAMA-M on "AUGERAT" 



CVRP1 


benchmarks. 


Data 




CAMA 








CAMA - R 








CAMA - M 


(Proposed Method) 




Set 


B.Cost 


Ave.Cost Std.Dev 


Success No. 


B.Cost 


Ave.Cost 


Std.Dev Su 


ccess No. 


B.Cost 


Ave.Cost 


Std.Dev Su 


ccess No. 


1 .A-n32-k5 


784 


748 





30 


784 


784 





30 


784 


784 





30 


2.A-n54-k7 


1167 


1169.50 


3.36 


19 


1167 


1167 





30 


1167 


1167 





30 


3.A-n60-k9 


1354 


1356.73 


3.5(1 


17 


1354 


1355.20 


1.86 


21 


1354 


1354.4 


1.22 


27 


4.A-n69-k9 


1159 


1164.17 


3.07 


16 


1159 


1162.20 


2.41 


24 


1159 


1161.43 


2.37 


28 


5.A-n80-klO 


1763 


1778.73 


9.30 


9 


1763 


1777.07 


7.94 


10 


1763 


1775.7 


8.80 


16 


6.B-n41-k6 


829 


829.30 


0.47 


21 


829 


829.93 


0.94 


10 




829.53 


0.73 


17 


7.B-n57-k7 


1140 


1140 





30 


1140 


1140 





30 


1140 


1140 





30 


8.B-n63-klO 


1537 


1537.27 


1.46 


29 


1496 


1528.77 


15.77 


30 


1496 


1525.86 


17.45 


30 


9.B-n68-k9 


1274 


1281.47 


5.56 


15 


1274 


1284.80 


4.51 


7 


1273 


1281.43 


5.74 


15 


10.B-n78-kl0 


1221 


1226.07 


5.48 


22 


1221 


1226.80 


6.39 


19 


1221 


1224.37 


3.23 


26 


H.P-n50-k7 


554 


556.33 


2.34 


14 


554 


554.93 


1.72 


23 


554 


554.26 


1.01 


28 


12.P-n76-k5 


627 


630.70 


5.34 


22 


627 


628.87 


1.61 


25 


627 


028.63 


1.51 


26 



Table 5: Statistic results of CAMA, CAMA-R, and CAMA-M on "CE" CVRP bench- 
marks^ 



Data 




CAMA 








CAMA - It 








CAM A - M 


(Proposed Method) 




Set 


B.Cost. 


Ave.Cost 


Std.Dev 


Success No. 


B.Cost 


Ave.Cost 


Std.Dev 


Suecess No. 


B.Cost 


Ave.Cost 


Std.Dev 


Success No. 


l.E-n33-k4 


835 


835 





30 


835 


835 





30 


835 


835 





30 


2.E-n76-k7 


682 


685.67 


2.17 


23 


682 


684.73 


1.31 


27 


682 


684.66 


1.12 


28 


3.E-n76-k8 


735 


737.57 


2.36 


18 


735 


737.17 


1.60 


21 


735 


737.06 


1.91 


23 


4.E-n76-klO 


830 


837.03 


3.56 


18 


831 


835.80 


3.19 


21 


830 


834.73 


2.92 


27 


5.E-n76-kl4 


1021 


1025.67 


3.48 


16 


1021 


1026.27 


3.33 


15 


1021 


1025.80 


3.64 


17 


6.E-nl01-k8 


816 


820.63 


3.20 


17 


815 


818.97 


1.94 


26 


815 


818.53 


1.55 


27 



Table 6: Statistic results of CAMA, CAMA-R, and CAMA-M on "CHRISTOFIDES" 
CVRP benchmarks. 



Data 




CAMA 








CAMA - R 








CAMA - M 


(Proposed Method) 




Set 


B.Cost. 


Ave.Cost 


Std.Dev 


Success No. 


B.Cost. 


Ave.Cost 


Std.Dev 


Success No. 


B.Cost 


Ave.Cost 


Std.Dev 


Success No. 


1.C50 


524.61 


525.45 


2.56 


27 


524.61 


524.61 





30 


524.61 


525.73 


2.90 


26 


2.c75 


835.26 


842.32 


4.04 


15 


835.26 


840.28 


3.52 


22 


835.26 


839.53 


3.45 


20 


3.cl00 


826.14 


829.43 


2.39 


11 


826.14 


829.73 


2.08 


9 


826.14 


829.13 


1.94 


12 


4.cl00b 


819.56 


819.56 





30 


819.56 


819.56 





30 


819.56 


819.56 





30 


5.cl20 


1042.11 


1044.18 


2.21 


18 


1042.11 
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Figure 7: Search convergence graphs of CAMA, CAMA - R, and CAMA - M 
on representative CVRP "AUGERAT" benchmarks. Y-axis: Fitness value, X-axis: 
Number of Fitness Evaluation or CPU Time in Seconds. 



generated using K-Means clustering. A CVRP instance is thus represented as input 
matrix X, see Fig. [5J which is composed of the coordinate features for all tasks in 
the problem. The desired vehicle assigned for each task (i.e., task assignment) is 
then given by the OS optimized solution, Y, of the respective CVRP instances. 

Besides the proposed meme induced population initialization procedure, two 
other commonly used initialization procedures for generating the population of so- 
lution individuals in the state-of-the-art baseline CAMA are also investigated here 
to verify the efficiency and effectiveness of the proposed memetic evolutionary 
search paradigm. The first is the simple random approach for generating the initial 
population, which is labeled here as CAMA-R. The second is the informed heuristic 
population initialization procedure proposed in baseline CAMA [9]. In particular, 
the initial population is a fusion of solution generated by Backward Sweep, Sav- 
ing, and Forward Sweep and random initialization approaches. The CAMA that 
employs the meme induced population initialization procedure of the proposed 
memetic evolution is then notated as CAMA-M, where the population of individu- 
als intelligently generated based on the fit memes that have been accumulated from 
past CVRP solving experiences via cultural evolutionary mechanisms of the meme 
learning, meme selection, meme variation and meme imitation. If no memes have 
been accumulated so far, CAMA-M shall behave exactly like the baseline CAMA. 

Last but not the least, the operator and parameter settings of CAMA-R, CAMA, 
CAMA-M are kept the same as that of Q for the purpose of fair comparison. For 
CAMA-M, the MMD of Equation [10] is augmented with the demand of each task as 
one of the problem feature. 
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Figure 8: Search convergence graphs of CAMA, CAMA - R, and CAMA - 
M on representative CVRP "CE" benchmarks. Y-axis: Fitness value, X-axis: 
Number of Fitness Evaluation or CPU Time in Seconds. 



6.1.2 Result and Discussion 

All the results obtained by the respective algorithms considered, across 30 inde- 
pendent runs on the CVRP instances, are summarized in Table HI Table [5] and 
Table [6] The Ave.Cost value of CAMA on each CVRP instance is used as the 
baseline for the Success. No criterion. The values in "B.Cost", "Ave.Cost" and 
"Success No." denoting superior performance are then highlighted in bold font. 

It can be observed from the results in Table |4] and Table [5] that in overall, 
CAMA-R achieved improved solution quality over CAMA in terms of Ave.Cost 
and Success No. on most of the "AUGERAT" and "CE" CVRP instances. Partic- 
ularly, on instance "A-n54-k7", CAMA-R consistently converges to the best solu- 
tion fitness across all the 30 independent runs, as denoted by "B.Cost". CAMA-R 
also attained an improved B.Cost solution over CAMA on instance "B-n63-kl0". 
However, as observed in Table [6j on the "CHRISTOFIDES" benchmarks, where 
the size of the problem instances scale up, relative to "AUGERAT" and "CE" (i.e., 
the graphs are bigger in size, with larger number of customers or vertices that 
require servicing), the current baseline state-of-the-art CAMA is noted to exhibit 
superior performances over CAMA-R in terms of Ave.Cost. In terms of B.Cost, 
CAMA is also observed to have attained superior solution quality over CAMA-R on 
instance "cl99". Since the only difference between CAMA-R and CAMA lies in 
the heuristic bias introduced in the population initialization phase of the latter, it 
is possible to infer from the performances of CAMA and CAMA-R that the appro- 
priate inductive biases made available in CAMA have been effective in narrowing 
down the search regions of the large scale problems. 

Moving on next to the proposed memetic computational search paradigm, the 
generation of the initial population of solutions is now guided by the memes learned 
from past problem-solving experiences. These memes thus serve as the instructions 
learned from the experiences along with the CARP instances solved, which are then 
imitated to enhance the search on new problem instances. As discussed in Section 
|3j the "meme pool" of CAMA-M is empty when the first CVRP instance is encoun- 
tered (e.g., "A-n32-k5" of "AUGERAT" benchmark problem), and thus CAMA-M 
behaves like the baseline CAMA. As more CVRP instances are encountered, the 
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meme learning, selection, variation and imitation mechanisms shall kick in to learn 
and generalize memes that would induced positive bias to the evolutionary search 
of new CVRP problems. It can be observed from TableHJ Table |5]and Table|6]that 
the CAMA-M converges to similar solutions attained by both CAMA-R and CAMA 
on the first problem instance of each CVRP benchmarks (since no memes are 
learned yet), but demonstrates superior performances over CAMA-R and CAMA on 
subsequent CVRP instances. In particular, on "AUGERAT" and "CE" benchmarks, 
CAMA-M exhibits superior performances in terms of Ave.Cost and Success No. 
on 13 out of total 19 CVRP instances. In addition, on "CHRISTOFIDES" bench- 
marks, CAMA-M also attained improved solution quality in terms of Ave.Cost 
and Success No. on 4 out of total 7 CVRP instances. Since CAMA, CAMA- 
R and CAMA-M shares a common baseline evolutionary solver, i.e., CAMA, and 
differing only in terms of the population initialization phase, the superior perfor- 
mance of CAMA-M can clearly be attributed to the effectiveness of the proposed 
memetic evolutionary search paradigm where meme induced solutions are intelli- 
gently generated from previous problem solving experiences for enhancing future 
evolutionary searches. 

To assess the efficiency of the proposed memetic search paradigm, representa- 
tive convergence graphs of CAMA, CAMA-R and CAMA-M on the CVRP bench- 
marks are also presented in Fig. |7J Fig. [8] and Fig. |9j respectively. Note that the 
Y-axis of the figures denote the actual fitness value obtained, while the X-axis 
gives the respective computational effort incurred in terms of both the Number of 
Fitness Evaluation made so far and CPU Time in seconds. As observed, CAMA-R 
is noted to converge faster than CAMA on most of the instances in "AUGERAT" 
and "CE" benchmarks (e.g., Fig. Ha), Fig. Hf), Fig. |ga), Fig. |gb), etc.). How- 
ever, on the large scale "CHRISTOFIDES" benchmarks, CAMA poses to search 
more efficiently, especially from beyond 1000 number of fitness evaluations (e.g., 
Fig- Ha), Fig. Hb), Fig. He), etc.). On the other hand, it can be observed that 
CAMA-M converges faster than both CAMA-R and CAMA on all the CVRP bench- 
marks. Particularly, on instances "B-n41-k6" (Fig. EZ£d)), "B-n63-kl0" (Fig. He)) 
and "B-n78-kl0" (Fig. 0T)), etc., CAMA-M takes only approximately 250 num- 
ber of fitness evaluations to arrive at the solution quality of CAMA-R and CAMA, 
which incurred more than 1500 number of fitness evaluations. On the large scale 
instances, such as "cl20" (Fig. Ha)), "cl50" (Fig. Hb)), etc., CAMA-M brings 
about at least 2000 number of fitness evaluations savings to arrive at the similar 
solution qualities of CAMA and CAMA-R. 

Next, we showcase samples of the initial solutions by CAMA, CAMA-R and 
CAMA-M, as well as the converged optimized solution of CAMA on solving prob- 
lem instance "B-n41-k6" in Fig. [TOj In the present context, an initial solution of 
CAMA-M, which has been intelligently generated using the positive biases intro- 
duced by memes learned and generalized from past experiences of problem solving 
on instances "A-n32-k5", "A-n54-k7", "A-n60-k9" and "A-n69-k9", is illustrated. 
In Fig. [T0l each node denotes a customer that needs to be serviced, and the nodes 
with the same color and shape shall be serviced by a common route or vehicle. As 
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Figure 9: Search convergence graphs of CAM A, CAM A - R, and CAM A - M 
on representative CVRP "CHRISTOFIDES" benchmarks. Y-axis: Fitness value, 
X-axis: Number of Fitness Evaluation or CPU Time in Seconds. 

observed, the task distributions for the initial solution of CAMA-M is noted to be 
most similar to that of the converged optimized solution of CAM A, as compared 
to that of CAMA and CAMA-R. Besides the task distributions, we also magnify 
portions of the figures to showcase some service orders of the initial solution in 
CAMA-M, relative to that of the converged optimized solution of baseline CAMA, 
in Fig. [TOlc) and Fig. [TOt d). respectively. The magnified subfigures illustrate 
high similarities between their respective service orders. This suggests that the ser- 
vice order structures of the converged optimized solution for instances "A-n32-k5", 
"An54-k7", "A-n60-k9" and "A-n69-k9" were successful learned and preserved by 
the meme learning operator, which are subsequently imitated as positively biased 
solutions (of the initial population in CAMA-M search) induced by the generalized 
meme, through the cultural evolutionary or memetic mechanisms of meme selec- 
tion, variation and imitation. 

6.2 Capacitated Arc Routing Problem 

Next, we proceed to evaluate the efficiency and effectiveness of the proposed 
memetic evolutionary search paradigm on the Capacitated Arc Routing Problem 
domain. 

6.2.1 Empirical Configuration 

The well-established egl benchmark is used in the present experimental study on 
CARP The data set was generated by Eglese based on data obtained from the win- 
ter gritting application in Lancashire ETl [22l [3TTl . This data set has been commonly 
used as benchmark dataset in the literature for CARP solving ff23ll35l . It consists 
of two series of datasets (i.e., "E" and "S" series) with a total of 24 instances. In 
particular, CARP instances in "E" series have smaller number of vertices, task or 
edges than that in "S" series, thus the problem structures of "E" series are deem 
to be simpler than "S" series. The detailed properties of each egl instance are pre- 
sented in Tableland Tabled "| V\", "\E R \", "E" and "LB" denote the number of 
vertices, number of tasks, total number of edges and lower bound, of each problem 
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(a) A depiction of a solution belonging to ( b ) A depiction of a solution belonging 

the initial population of baseline CAMA. . to the initial population of CAMA-R. 




(c) A depiction of a meme-induced solution 
belonging to the initial population of CAMA-M. 



(d) A depiction of the optimized solution 
obtained by baseline CAMA. 



Figure 10: Illustration of the optimized solution and initial solutions of the algo- 
rithms considered on "B-n41-k6" CVRP benchmark. 



Table 7: Properties of the egl "E" Series CARP benchmarks. 
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4498 
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5018 


6305 


8243 


5898 


7704 


10163 


6048 


8884 


11427 



instance, respectively. 

In traditional CARP, each task is represented by a corresponding head vertex, 
tail vertex, travel cost and demand (service cost). The shortest distance matrix of 
the vertices is first derived by means of the Dijkstra's algorithm EDI , i.e., using 
the distances available between the vertices of a CARP. The coordinate features 
(i.e., locations) of each task are then approximated by means of multidimensional 
scaling [3 ]. In this manner, each task is represented as a node in the form of coordi- 
nates. A CARP instance in the current setting is thus represented by input vector X 
composing of the coordinate features of all tasks in the problem. Such a represen- 
tation would allow standard clustering approaches, such as the K-Means algorithm 
to be conducted on the CARP in task assignments, and allow the pairwise distances 
sorting among tasks available for preserving service orders. The label information 
of each task in Y belonging to the CARP instance, is as defined by the optimized 
solution of CARP 

For empirical comparisons, three solution population initialization procedures 
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Table 8: Properties of the egl "S" Series CARP benchmarks. l"-axis: Fitness value, 
X-axis: Number of Fitness Evaluation or CPU Time in Seconds. 
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Table 9: Statistic results of ILMA, ILMA-R, and ILMA-M on egl "E"-Series CARP 
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Table 10: Statistic results of ILMA, ILMA-R, and ILMA-M on egl "S"-Series CARP 
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Figure 1 1 : Search convergence graphs of ILMA, ILMA — R, and ILMA — M 
on representative CARP "E"-Series benchmarks. Y-axis: Fitness value, X-axis: 
Number of Fitness Evaluation or CPU Time in Seconds. 



based on ILMA are also considered here. The first is a simple random approach, 
which is labeled here as ILMA-R. The second is the informed heuristic based pop- 
ulation generation procedure used in the baseline state-of-the-art ILMA ll35l for 
CARP. There, the initial population is formed by a fusion of chromosomes gener- 
ated from Augment_Merge [24], Path_Scanning l25l . Ulusoy's Heuristic 11481 and 
the simple random initialization procedures. The last is our proposed solution gen- 
eration using past problem solving experiences with memetic evolution, which is 
labeled here as ILMA-M. In ILMA-M, the meme pool is empty at start, while new 
memes shall be accumulated with increasing CARP instances optimized. Thus, 
once again, the ILMA-M performs exactly like ILMA on the first problem instance 
encountered, since it is meant to serve as an intelligent ILMA whose intellectual 
shall increase with increasing problems solved. 

To facilitate a fair comparison and verify the benefits of the learning from past 
experiences, the evolutionary operators of ILMA and its variants are configured as 
consistent to that reported in (33. Further, in ILMA-M, the MMD of Equation [TOl 
is augmented with the demand of each task. 

6.2.2 Result and Discussion 

Table [9] and Table \\0\ tabulate the results that measure the solution quality on the 
"E"-Series and "S"-Series egl CARP datasets as obtained by the respective algo- 
rithms, across 30 independent runs. The Ave.Cost value of ILMA on each prob- 
lem instance is used as threshold level in the Success No. criterion. In the tables, 
the method with superior performance with respect to "B.Cost", "Ave.Cost" and 
"Success No." are highlighted in bold font. 
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As can be observed from Tableland Table [TOl the ILMA-R has attained com- 
petitive performance on solution quality over ILMA-R, on instances such as "El- 
A", "El-B", "E2-A", "Sl-A", "Sl-B" and "S2-A", etc. However, with the incorpo- 
ration of heuristic information as inductive search bias in the baseline state-of-the- 
art ILMA, it is noted to attain improved performance in terms of solution quality 
over ILMA-R on the large scale instances (i.e., instances with greater service arcs, 
travel edges, or number of vertices, etc.), which include "E3-C", "E4-A", "E4-B", 
"E4-C", "S3-C", "S4-A", and "S4-C". 

Turning then to the proposed memetic evolutionary search paradigm, it can be 
seen from Table [9] and Table [TOl that. ILMA-M performed competitively to ILMA 
on instances "El-A" and "Sl-A" as expected since these are the first encountered 
problem instances of ILMA-M on the "E" and "S" egl CARP benchmarks, respec- 
tively, where no memes are available in the meme pool. As more problem instances 
are optimized, the ILMA-M is observed to demonstrate superior performance over 
ILMA in terms of Ave.Cost on 18 out of total 24 egl benchmarks. In terms of 
B.Cost, ILMA-M achieved 2 and 8 improved solution qualities over ILMA and 
ILMA-R on the "E" and "S" series egl datasets, respectively. 

Similarly, to demonstrate the efficiency of our proposed memetic evolution, the 
search convergence traces of ILMA, ILMA-R, and ILMA-M on several representa- 
tive instances of "E" and "S" series egl benchmarks are depicted in Fig. QT] and 
Fig. El respectively. As can be observed, for ILMA and ILMA-R, on the simpler 
problems such as "El-C" (Fig. Oa)), "E2-B" (Fig. nib)), "Sl-C" (Fig. Ob)) 
and "S2-B" (Fig. Etc)), etc., ILMA and ILMA-R demonstrated competitive con- 
vergence speed. Nevertheless, as the complexity of the problems increase, i.e., 
such as "E3-C" (Fig. Eld)), "E4B" (Fig. Ele)), "E4C" (Fig. Elf)), "S3-C" 
(Fig. Ete)) and "S4-C" (Fig. Etf», etc., ILMA consistently converges faster than 
ILMA-R with improved solution attained. Further, for our proposed memetic evolu- 
tionary search paradigm, on both the "E" and "S" series egl benchmarks, ILMA-M 
consistently converges more efficiently than ILMA and ILMA-R on almost all the 
instances presented. Overall, ILMA-M is noted to bring about at least 2 x 10 6 sav- 
ings in the number of fitness function evaluations to arrive at the solutions attained 
by both ILMA and ILMA-R on most of the CARP instances (e.g., Fig. Eta), Fig. 
Etc), Fig. [TTT e). Fig. Etc), Fig. [T2f d). etc.). For instance, it is worth noting 
that on instance "Sl-B" (Fig. Eta)), ILMA-M used up a total of 1.5 x 10 6 number 
of fitness function evaluations to converge at the solution incurred by ILMA and 
ILMA-R, which otherwise used up a significant large fitness evaluations of approx- 
imately 6 x 10 6 . This equates to a total savings of 4 times by ILMA-M over ILMA 
and ILMA-R. 

7 Conclusion 

In this paper, we have proposed a Memetic Computational Paradigm for search to 
model how human solves problems and presented a novel study towards intelligent 
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Figure 12: Search convergence graphs of ILMA, ILMA — R, and ILMA — M 
on representative CARP "S"-Series benchmarks. Y-axis: Fitness value, X-axis: 
Number of Fitness Evaluation or CPU Time in Seconds. 



evolutionary optimization of problems through the transfers of structured knowl- 
edge in the form of memes learned from previous problem-solving experiences, 
to enhance future evolutionary searches. In particular, the four culture-inspired 
operators, namely, Meme Learning, Meme Selection, Meme Variation and Meme 
Imitation have been realized based on the HSIC, MMD criterion and K-means 
Clustering in the context of combinatorial routing problems. In contrast to existing 
works, the proposed novel memetic search paradigm enables knowledge transfer 
and reuse in evolutionary optimization across problems of different size, structure, 
or representation, etc. Last but not least, comprehensive studies on two widely 
studied NP-hard routing problems, namely, CVRP and CARP, confirmed the ef- 
ficiency and effectiveness of the proposed paradigm for intelligent evolutionary 
optimization across problems. 
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